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FIG. 9 



FIG. 10 



FIG. 11 
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Play Song Screen 




Play Radio Screen 
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Alternative 3D Music Stage Interface 
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Parameter 


Values 


Description 


AutoPlay 


On/Off 


If AutoPlay is On, the MadPlayer automatically starts 
playing the first Play list contained on a SmartMedia 
card when inserted. 


Power Off 


Disabled, 
lmn to 60mn 
in steps of 
lmn. 


Auto power off delay. The MadPlayer will power off 
automatically after this delay if no user action is 
detected. 


AutoRepeat 


40ms to 
600ms in 
steps of 
20ms 


Keyboard auto-repeat delay in milliseconds. Delay 
before repeating the corresponding action when a key is 
pressed continuously. 


EQ Preset 


Factory 

Woof 

Hitek 

Flat 

User 


Presets for 4-band equalizer. Factory, Woof, HiTek and 
Flat are factory presets and fixed. User preset can be 
configured by the User via the System-Equalizer menu. 


Mic State 


On/Off 


Microphone input is On or Off. 


Mic Volume 


0 to 31 


Microphone volume. 


Echo Level 


Oto 127 


Level of echo applied to microphone input 


Echo Time 


Oto 127 


Microphone echo delay. 0 shortest, 127 longest. 


Echo Feedbk 


Oto 31 


Rcho ffifiHhar.lv * 0 minimum fppHharlr 197 maYimnm 

xv->v_/\ui_;ca\^iv. \J 1111111111L1111 l^^LlUdCiV, L^. / HldAllilUlll 

feedback. 


Rec Format 


PCM 

HQFADPC 
M 


Format used to store recorded samples: 
PCM: PCM, 16bits mono, 19.31kHz 
HQFADPCM: High Quality ADPCM 


Language 


English 

Francais 

Espanol 


Language used for the menus. 


oort riles 


By Name 
r>y iype 


Criterion used to sort files when displaying a list: by 
name (alohabeticallv^ or bv tvne ( sonf?s samnle^ 
lists...). 


Sort Presets 


By Name 
By Freq 


Criterion used to sort radio presets: by name 
(alphabetically) or by frequency. 


Product 


String 


Read Only. Hardware version 


Release 


String 


Read Only. Firmware version 



Configuration Parameters 



FIG. 14 
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Style and 
Instrument 



1 . Apply Block Rules 



\7 



Virtual Pattern Sub 
Blocks 



2. Apply rhythmic rules to combine into series 



Iz 



Virtual 
Pattern 



.1 



3. Apply musical rules to generate basic music 



Non-Chorded 
Pattern (NCP) 



4. Apply Tonic 



NCP with 
Tonic 



5. Apply Mode 



Iz 



NCP with Tonic & 
Mode 



6. Apply Key 



Iz 



Real Pattern 



\z 



7. Apply any global pitch adjustment in real 



General Musical Generation Flow 
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Figure 16C 
Exemplary Automated Music Analysis 
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Style and 
Instrument 



v 



Rhythmic 
Event(s) 



v 



la. Create Rhythmic Events using Style and/or Instrument 
related parameter data (e.g., First Max %, Resolution Grid, 
and/or Pulse min/max). 



lb. Assign durations to Rhythmic events using rhythmic rules 
(e.g., Silence %, Chord %, Chord Duration Sensitivity %, 
Chord Velocity Sensitivity %, Velocity Accent, Velocity 
Dynamic, and/or Humanization). 



Virtual Pattern 
Sub Blocks 



Figure 160 
Sub-Block Generation 
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Hexadecimal Value 


Internal Nomenclature 


P ntpviti nl Vnlitpv 

J. kjvCI 11 ILll r LtlLltsJ 


40 


Base Note 


C, E, G, B 


41 


Magic Note 1 


+1,-1, +2, -2 


42 


Magic Note 0 


+1, -1, +2, -2, 0 


43 


High Note 


+7 


44 


Last Note 


C,G 


45 


One Before Last Note" 


E, G, B 


46 


ALC Controller 






• Harmonic Note 


0, +2, +4, +6, -3, -5, -7 




• Fixed Note 


any 



Examples of Virtual Notes/Controllers 



FIG. 17 
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Treble Instrument, such as a 
violin, with an optimum 
range that is relatively high in 
pitch: 



Midrange Instrument, such as 
a guitar, with an optimum 
range that is relatively 
medium in pitch. 



Bass Instrument, such as a 
bass guitar, with an optimum 
range that is relatively low in 
pitch. 



Example of Tessitura 

FIG. 18A 
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from R 
_ , _ 



No 
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from modified R 




No 



FIG. 18B 



Create new real note based on previous 
real note plus modifier indicated by D 
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Key 


Chord 


A 


C 


D 


G 


Offset 


-3 


0 


+2 


+8 
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ividual Notes 


All Notes 
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Musical Notation 



Software Notation 
(QN=30) 



Virtual 
Pattern 
Sub- 
Blocks 



Virtual 
Pattern 
(VP) 



C4 = Base Note 

F#4 = Magic Note Type 1 

D4 = Magic Note Type 0 

CM = High Note 

C4 = Base Note 




00 91 30 70 le 81 30 

00 91 36 64 le 81 36 

00 91 32 If le 81 32 

00 91 31 72 le 81 31 

3C 91 30 64 2d 81 30 



Non- 

Chorde 

d 

Pattern 
(NCP) 

NCP 
with 
Tonic 
(PwT) 



■9 W 



iJ J J r 



00 91 34 70 le 81 34 

00 91 32 64 le 81 32 

00 91 32 7f le 81 32 

00 91 3e 72 le 81 3e 

3C 91 37 64 2d 81 37 



00 91 31 70 le 81 31 

00 91 2f 64 le 81 2f 

00 91 2f 7f le 81 2f 

00 91 3b 72 le 81 3b 

3C 91 34 64 2d 81 34 



PwT 

with 

Mode 

(PwTM 

) 



Real 

Pattern 

(RP) 



^ j r 



00 91 30 70 le 81 30 

00 91 2f 64 le 81 2f 

00 91 2f 7f le 81 2f 

00 91 3b 72 le 81 3b 

3C 91 34 64 2d 81 34 



00 91 32 70 le 81 32 

00 91 31 64 le 81 31 

00 91 31 7f le 81 31 

00 91 3d 72 le 81 3d 

3C 91 36 64 2d 81 36 



Example of VP-to-RP Flow 
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Rhythmic Blocks/Sub-Blocks 




damn 



I 



Conditions 



All variations, given: 

• eighth note is smallest unit 

• length of 1 quarter note 

• all full rests are indicated 
separately as 'empty' 



All variations, given: 

• eighth note is smallest unit 

• length of 2 quarter notes 

• does not include 1 quarter 
note variations above 



RJiythmic Variations based on Duration 

FIG. 22 
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Time 



Relative Mobility of Note Pitch 

FIG. 23 
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Drum Seed (DS) 
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Drum Part 
Generation 
Algorithm 
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DS 
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Drum Part D 
Pseudo-Random Number Implementation 1 
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Application Revision 


Firmware/application version used to generate the data 
structure 


Style, SubStyle 


The style and/or substyle 


Sound Bank, Synth Type 


The sound bank/synth type 


Sample Frequency 


How often a sample is played in song 


Sample List 


List, of samples associated with the Style 


Key 


First Key used, pitch offset 


Tempo 


Start Tempo (e.g., in pulses per quarter note) 


Instrument 


Identification of a particular instrument in an instrument 
group. Indexed by type of instrument 


State 


State of instrument indexed by instrument type (e.g., 
muted, un-muted, normal, Forced play, solo, etc.) 


Parameter 


Instrument parameters indexed by instrument type (e.g., 
volume, pan, timbre, etc.) 


PRNG Seed Values 


Seed values used to initialize the PRNG routines 



Simple Data Structures 

FIG. 28 
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Determine/Load initial seed values 



Generate music with song 
structure for a given song part 



Update user interface 




Go to next song part. 
Determine/load relevant 
seeds if necessary. 



Save all seeds 
(as part of Song 
Structure) to 
non-temporary 
Memory Storage 




Update any 
relevant seeds 
in temporary 
storage 



Example of SDS Flow 

FIG. 29 
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Application 
Revision 


Firmware/application version used to generate the data 
structure 


Style, SubStyle 


The style and/or substyle 


Sound Bank, Synth 
Type 


The sound bank/synth type 


Sample Frequency 


How often a sample is played in song 


Sample List 


List of samples associated with the Style 


Key 


First Key used, pitch offset 


Tempo 


Start Tempo (e.g., in pulses per quarter note) 


Song Structure 


Number of types, number of parts, sequence of parts, etc. 


Structure 


For every part: number of sub-parts, sequence of sub- 
parts, etc. Indexed by Part 


Filtered Track 


Type, function (e.g., sawtooth wave, sine wave, square 
wave, etc.), initial value, etc., of an effect. Indexed by 
Part. 


Progression 


Time signature, number of SEQs, list of maked types, etc. 
Indexed by Sub-Part. 


Chord 


Time stamp, chord vector, key note, progression mode, 
etc. Indexed by Sub-Part. 


Pattern 


Combination (Instrument), block data, effects data, etc. 
Indexed by Type. 


Combination 


List of instruments. Sub-set of 'Pattern 5 above. 


FX Pattern 


Effects data. Sub-set of 'Pattern' above. 


Blocks 


Block data. Subset of 'Pattern' above. 


Instrument 


Identification of a particular instrument in an instrument 
group. Indexed by type of instrument 


State 


State of instrument indexed by instrument type (e.g., 
muted, un-muted, normal, Forced play, solo, etc.) 


Parameter 


Instrument parameters indexed by instrument type (e.g., 
volume, paraml, param2, etc.) 


Improv 


Improvisation data (e.g., certain instruments or notes) that 
might be different each time the song is played. 



Complex Data Structures 



FIG. 30 
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Determine/load initial seed values, as well as data corresponding to song structure, structure, 
filtered track, progression, chord, pattern, instrument, state, parameter, and improv data. 



Generate music with song structure for a given song part 




Save all seed values, as well as data 
corresponding to song structure, structure, 
filtered track, progression, chord, pattern, 
instrument, state, parameter, and improv 
data to non-temporary memory storage 



Update any relevant 



data corresponding 
to song structure, 
structure, filtered track, 
progression, chord, 
pattern, instrument, 
state, parameter, and 

improv data in 
non-temporary storage 



Go to next song part. Determine/load relevant 
seeds, as well as relevant data corresponding to 

song structure, structure, filtered track, 
progression, chord, pattern, instrument, state, 
parameter, and improv data if necessary. 



Example of CDS Flow 

FIG. 31 
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Additional Variation 

FIG. 33 
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Audio Audio 
In Out 



Video Video 
In Out 



MIDI 
I/O 
75 



FIG. 34 
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Split into] 
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Multi-Use 
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Always 
Loaded « 
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Block Buffers 



Song Buffers 
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cs ram: 




BOOT 



NA 



RAM 



NA 



NA 



NA 



RAM 



NA 



NA 



Flash 



NS 



RAM 



NS 



RAM 



NS 



Flash 



NS 



v Normal 
Mode 



\. Upgrade 
Mode 



CS_RAM and CS_ROM 
are active low 

NS = Nothing Selected 

NA = Not Applicable 



FIG. 
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Audio 

Stream * 
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Audio 



MIDI/Audio Stream 
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Audio 
Stream < 

Cyo') 
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Stream^ 
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i 
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Time 



Simplified MIDI/ Audio Stream Timeline 
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NRPN 






Stream 
(Hexadecim 
ai) 


Indication/Meaning 


1 


BO 


Channel Number 


2 


63 


iNivriN ^/Uiiiiuncr /\ ^c.g., duuio Sctrnpie typej 


3 


40 


lueniiiication oi sample type i^e.g., long, snort, stereo, mono, 
etr ^ 


4 


00 


Delta time 


5 


62 


7\TRPT\J f^nntrnllpr /V a anHin pfT^r'tc t\mp»^ 


6 


00 


Identification of effects type (ping pong, ripple, phaser, 
distortion, etc.) 


7 


00 


Delta time 


8 


06 


Identification of register for NRPN Controller A value 


9 


03 . 


NRPN Controller A value (play 3 rd audio sample in set, '00' is 
random) 


10 


00 


Delta time 


11 


26 


Identification of register for NRPN Controller B value 


12 


07 


NRPN Controller B value (apply audio effect #7, 4 00' is 
random) 



Simplified NRPN Example 



FIG. 41 
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A 



250ms 



Note = On 
Channel = 1 
Pitch = C 



A 2 



50ms 



NRPN 

Audio X, [P], [E] 



A 



250ms 



Note = Off 
Channel = 1 
Pitch = C 



Simplified Special MIDI Type File 



FIG. 42 
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CPU 

Functional 
Unit 



Mep 1 : prepare 
control stream based 
on text, generative 
algorithms, and/or 
other means 



Step 2: send control 
stream to DSP 
function referencing 
vocal library 



Step 3 : access vocal 
library stored in 
memory locations 

Step 4: generate vocal 
track sound output 




MIDI/DSP 
Functional 
Unit 




Memory 
Locations 



V 



Sound 
Output 
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21) Generate/load text data 






22) Parse text data into phonetic descriptor stream, generate/load 
characteristics associated with text (e.g., pitch, amplitude, and/or duration) 






23) Process each phonetic descriptor, in association with any related 
characteristics, to generate a control stream (e.g., a MEDI-compatible stream) 




r 


24) Process control stream; access vocal library and assemble series j 
sounds comprising the vocal track 


> 


f 


25) Perform any final processing (e.g., 'smoothing' amplitude, etc.) and 
output sound as part of music output 



FIG. 44 
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Portable Musical 
Generation Device 
30 



Visual Output Interface 
32 




Storage 
Memory 
39 



Text Input Interface 
36 



Data I/O 
Interface 
38 
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SLS Header 
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Slotted Structure 

FIG. 47 
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SLS Header 
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Sample Data Structure 
540 with Optical 
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585 580 575 570 565 560 555 
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Name A 600 
Period Info 601 
Pitch Info 602 
Other Info 603 



NameB 605 
Period Info 606 
Pitch Info 607 
Other Info 608 



NameC 610 
Period Info 611 
Pitch Info 612 
Other Info 613 



Name A 600' 



NameB 605' 



NameC 610' 



Separate Descriptor File 615 



Native format Sample Files 
616 



FIG. 53 



f . r 10/54164© 



650) Access/Load sample i 




f 


651) Analyze sample to derive rhythmic characteristics 


> 


f 


652) Analyze sample to derive pitch characteristics 


> 


f 


653) Prepare information identifying pitch and/or 
period characteristics 


> 


f 


654) Assemble characteristic information (e.g., into a separate 
descriptor file or as a header portion of the sample 


> 




655) Save sample and/or separate descriptor file 



FIG. 54 
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664 

I 



No 





Access sample file descriptors 








666-^ 


Process based on current 


global pitch and/or 
rhythmic information 



668 



Prepare DSP operations 
to control speed and/or pitch 
of sample based on global 
information 




Play sample along with any DSP operations 
to control speed and/or pitch of sample 
based on global information 



FIG. 55 
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Antenna 
800 



Transmission 
Reception 
Circuit 
805 



< — > 



Telephone/PDA 
Unit 
810 



Communication 
Interface 
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Display 
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Music Generator 825 



Music 


DSP 
Block 
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Block 
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Audio 
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Speaker 
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Application Revision 


Firmware/application version used to generate the data 
structure 


oiyie, oubotyle 


The style and/or substyle (and/or Radio Station Style) 


Sound Bank, Synth 
Type 


The sound bank/synth type 


Sample Frequency 


How often a sample is played in song 


Sample List 


List of samples associated with the Style 


jvey 


First Key used, pitch offset 


Tempo 


Start Tempo (e.g., in pulses per quarter note) 


ouiig oLTucLure 


Number of types, number of parts, sequence of parts, etc. 


Structure 


For every part: number of sub-parts, sequence of sub- 
parts, etc. Indexed by Part 


Filtered Track 


Type, function (e.g., sawtooth wave, sine wave, square 
wave, etc.), initial value, etc., of an effect. Indexed by 
rart. 


rrogression 


Time signature, number of SEQs, list of maked types, 
etc. Indexed by Sub-Part. 


Chord 


Time stamp, chord vector, key note, progression mode, 
etc. Indexed by Sub-Part. 


Pattern 


Combination (Instrument), block data, effects data, etc. 
Indexed by Type. 


Combination 


List of instruments. Sub-set of 'Pattern' above. 


r a. ranern 


bffects data. Sub-set of 'Pattern' above. 


Blocks 


Block data. Subset of 'Pattern 5 above. 


Instrument 


Identification of a particular instrument in an instrument 
group. Indexed by type of instrument 


State 


State of instrument indexed by instrument type (e.g., 
muted, un-muted, normal, Forced plav. solo, etc.) 


Parameter 


Instrument parameters indexed by instrument type (e.g., 
voiume, parami, paramz, etc.) 


PRNG Seed Values 


Preferably a series of numerical values that are used to 
initialize the pseudo-random number generation (PRNG) 
routines (used in certain embodiments). 


Sound Bank Data 


Soundbank data associated with a particular song; 
preferably loaded into non-volatile memory such that the 
sound bank data may be used during the generation of 
music output. 



Example Music Data File 



Figure 59 
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| Receive broadcast music 


lata file 715 from transmitter 710 862 864 


> 




Determine/load initial seed values, and/or data corresponding to song structure, structure, 
filtered track, progression, chord, pattern, instrument, state, parameter, etc. 



I 



Generate music with song stru cture for a given song part 

1 




Save all seed values, as well as data 
corresponding to song structure, structure, 
filtered track, progression, chord, pattern, 
instrument, state, parameter, etc., to 
non-temporary memory storage 



No 






Update any relevant 




seeds, and/or 




data corresponding 


^ 


to song structure, 




structure, filtered track, 




progression, chord, 




pattern, instrument, 




state, parameter, etc., 




in temporary storage 



Go to next song part. Determine/load relevant 
seeds, as well as relevant data corresponding to 

song structure, structure, filtered track, 
progression, chord, pattern, instrument, state, 
parameter, etc., if necessary. 



876 y 

Example of Music 
Generation Flow 

FIG. 60 
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Data Services 


Description 


TIA/EIA IS-95A 


Mobile Station-Base Station Compatibility standard for Dual- 
Mode Wideband Spread Spectrum Cellular Svstem 


TTA/EIA IS-99 


Data Service Option standard for Wideband Snread Snertmm 
Digital Cellular System 


TIA/EIA IS-637 


Short Message Service for Wideband Spread Spectrum Cellular 
System 


TIA/EIA IS-657 


Packet Data Service Optional standard for Wideband Spread 
Spectrum Systems 


TIA/EIA IS-658 


Data Services Interworking Function Interface for Wideband 
Spread Spectrum Systems 


TIA/EIA IS-707 


Short Message Service 14.4 Kbps 


TIA/EIA TSB-79 


Short Message Service for Wideband Spread Spectrum Systems 


TIA/EIA TSB39-A 


Message Type Assignments 



Exemplary Standards associated with 
Cellular Data transmission/Reception Services 



Fig. 61 
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SMS Broadcast Message Parameters 



Parameter 


Type 


Broadcast Service Category 


Mandatory 


Bearer Data 


Optional 



The Bearer Data parameter variable-length format: 



Field 


Length (bits) 


PA RAMETERJD 


8 


PARAMETER LEN 


8 


One or more occurrences of the fol 


owing subparameter record: 


SUBPARAMETER ID 


8 


SUBPARAM LEN 


8 


Subparameter Data 


8 oo 




SUBPARAM LEN 



PARAMETERJD: SMS parameter identifier. This field shall 
be set to '00001000'. 



PARAMETERJLEN: SMS message parameter length. This 
field shall be set to the number of octets in the parameter, not 
including the PARAMETERJD and PARAMETER LEN 
fields. 

SUBPARAMETER JD: Subparameter identifier. 

SUBPARAMJLEN: Subparameter length. This field shall be 
set to the number of octets in the subparameter, not including the 
SUBPARAMETERJD and SUBPARAMJLEN fields. 

Subparameter Data: Subparameter data fields. 



Exemplary Excerpts from 
TIA/EIA IS-637 Short Message Service for Wideband 
Spread Spectrum Cellular System 



Fig. 62 



Audio Event 901 
(e.g., MIDI event) 



Audio Synthesis 900 



Samples 903 
(e.g., Left and Right 
channels, at 44.1kHz) 

► 



Parameters 902 
(e.g., DLS2 parameter data) 



Figure 63 
Exemplary Synthesis 
Structure 



r (I) Interpolation 

I (e.g., Read data at different speeds to get 

J an A from a G sample) 

Monaural <f 

J (II) Filter 

( (e.g., Low pass filter with resonance) 



(III) Gain 

(E.g., And split to create stereo) 



Figure 64 
Exemplary Synthesis Process 
Flow 
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Source 
Sample- 
Data 
910 



Pitch 
Parameter(s) 
912 



Filter 
Parameters 
914 



Gain 
Parameters 
916 



R 

918 



■e- 



(I) 


-> 


GO 


► 


(III) 


Interpolate 




Filter 




Gain 



L 

920 



Sum (e.g., 
all tracks 
per channel) 

->e— 



4 



926 



L928 



Figure 65 
Exemplary Synthesis 
Structure 
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Calculate new 
parameter often 
(e.g., at 44kHz, 44 times 
every millisecond) 




0 



10 



Milliseconds 



Figure 66 
Prior Art Waveform 
Calculation Timing 



Calculate new 
parameter less often 
(e.g., at 44kHz, 1 times 
every millisecond) and use 




-f — i — i — i — i — i — i — i — i — i — i — i 

0 5 10 

Milliseconds 



Figure 67 
Exemplary Waveform 
Calculation Timing 
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Calculate new 
parameter seldomly 
(e.g., at 44kHz, 1 times 
every 5 millisecond) and use 




0 5 10 

Milliseconds 



Figure 68 
Exemplary Waveform 
Calculation Timing 



Rate: 22050 
Length: 6467 




H — I — I — I — I — I — I — I — I — I — I — I — I — I 

0 1000 6500 

Samples 



Figure 69 
Prior Art Tom Sound 
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Rate: 22050 
Length: 316 
Sample Size: 8 




Loop 



-I 1 1 1 1 1 1 1 1 1 1 1 1 1 

0 100 600 

Samples 



Figure 70 
Exemplary Tom Sound 



Rate: 22050 
Length: 2029 
Sample Size: 16 




0 400 2600 

Samples 



Figure 71 
Prior Art Flute Sound 




Figure 72 
Exemplary Flute Sound 



Rate: 22050 
Length: 7588 
Sample Size: 16 




\ 1 1 1 1 1 1 1 1 1 1 1 1 



0 



1250 



7500 



Samples 



Figure 73 
Prior Art Piano Sound 
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Rate: 22050 
Length: 54 




H 1 \ 



Loop 



H 1 1 1 1 1 H 



\ 1 1 



o 



10 



60 



Samples 



Figure 74 
Exemplary Piano Sound 
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^-Loop 



S_sax76 
Rate: 22050 
Length: 1289 
Sample Size: 16 



H 1 1 1 1 



o 



300 



Samples 



1600 



0 



Oboe_69a 
Rate: 22050 
Length: 1631 
Sample Size: 16 




H — I — I 1 — I — I — h 



300 




Samples 



-Loop 



1600 



Figure 75 
Prior Art Saxophone and 
Oboe Sounds 




+—{ 1 h — I F 



Loop 



-i — h 



SaxfW4a 
Rate: 11025 
Length: 132 
Sample Size: 8 



H 1 1 1 1 

180 



0 



30 



Samples 



H 1 1 1 1 h 




-Loop- 

H h 



SaxfiMa 
Rate: 11025 
Length: 132 
Sample Size: 8 



H 1 1 1 1 

180 



0 



30 



Samples 



Figure 76 
Exemplary Saxophone and 
Oboe Sounds 



